Two-limit Problems for Almost Semicontinuous Processes Defined on a Markov Chain

نویسنده

  • Ievgen Karnaukh
چکیده

Problems related to the exit of a process with independent increments from an interval were investigated in many works (see, e.g. [1], [2]). Analogous problems were investigated for processes on a finite Markov chain under the semicontinuity condition [3, 4]. For walks on a countable Markov chain, a two-dimensional problem was studied in [5]. In the present paper, we consider distributions of some functionals associated with the exit from a bounded interval for a process with independent increments on a finite Markov chain under the assumption that this process crosses a positive level only by exponentially distributed jumps (an almost semicontinuous process [6]). The distributions of overjump functionals described by integral equations on a semi-axes are defined by the projection factorization method using an infinitely divisible factorization (instead of canonical factorization). In the present paper, we investigate functionals described by integral equations on an interval that can be extended to a semi-axes. In the solution of the extended equation, we use the method developed by Krein in [7, 8] and probability factorization identities. Consider a two-dimensional Markov process:

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain

 In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

متن کامل

Overshoot Functionals for Almost Semi-continuous Processes Defined on a Markov Chain

The distribution of extrema and overjump functionals for the semi-continuous processes (processes that intersect positive or negative level continuously) on a Markov chain were considered by many authors( for instance, see [1] [3]). In the paper [4] the distribution of extrema for almost semi-continuous processes were treated (the processes that intersect positive or negative level by exponenti...

متن کامل

Algorithms for Computing Limit distributions of Oscillating Systems with Finite Capacity

We address the batch arrival  systems with finite capacity under partial batch acceptance strategy where service times or rates oscillate between two forms according to the evolution of the number of customers in the system. Applying the theory of Markov regenerative processes and resorting to Markov chain embedding, we present a new algorithm for computing limit distributions of the number cus...

متن کامل

Absorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping

In this paper, absorbing Markov chain models are developed to determine the optimum process mean levels for both a single-stage and a serial two-stage production system in which items are inspected for conformity with their specification limits. When the value of the quality characteristic of an item falls below a lower limit, the item is scrapped. If it falls above an upper limit, the item is ...

متن کامل

ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009